Intuitive Environmental Perception Assistance for Blind Amputees Using Spatial Audio Rendering

Vision and touch are essential sensory systems for human to interact with the environment. For blind amputees, how quickly intuitively convey environmental information them is one of key issues recovering their daily living ability. Inspired by auditory localization ability human, we constructed a virtual scene almost identical reality, concurrently added sound source interactive object. Leveraging method spatial audio rendering (SAR), three-dimensional motion can be vividly simulated in real-time. Finally, myoelectric prosthetic control system was developed assist amputees activities, The Fitts’ law test on target conducted both SAR voice prompt (VP) based path guidance methods, results indicate that significantly improves transfer rate. show reduces completion time half than VP, while restoring natural grasping path. With advantage intuitive rich perception, demonstrated potential applications reconstruct loops.